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10 Field of the Invention 

The present invention relates to pipeline processor design, more 
especially to protecting a processor pipeline against conflicts. 

15 

Background of the Invention 

Typically, modern processing engines, such as are found in digital 
signal processors (DSP's) or microprocessors employ a pipelined architecture 

20 in order to improve processing performance. A pipelined architecture means 
that various stages of instruction processing are performed sequentially such 
that more than one instructiqn^will be at different stages of processing within 
the pipeline at any one f^a^er 

Although a pipelined architecture does allow higher processing speed 

25 than would be possible if the processing of one. instruction were to be 
completed before the processing of another could be started, this does lead to 
significant complications regarding potential conflicts in operation. Conflicts 
may occur between resource accesses, for example in a situation where a 
second instruction attempts to access a register or a part of a register before a 
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first instruction has finished operations on that register, whereby the second 
instruction might receive invalid data. 

Such potential conflicts are often termed "data hazards". Examples of 
possible data hazards are in cases of, for example: 

- read after write (ex: ARx = ARy followed by *ARx = kl6) 

- write after read (ex: ARx = ARy followed by mar(ARy=P16)) 

- write after write (ex: ARx = ARy followed by mar(ARx=P16)) 
Various techniques for hardware pipeline protection are known in the 

art. 

One example is termed "scoreboarding". With scoreboarding each 
register or field can have pending writes and reads qualified with their 
execution phase using a table, or scoreboard. However, such an approach can 
be complex to handle and expensive in terms of logic overhead and, as a 
consequence, in power consumption. Particularly in processing engines 
designed for portable applications or applications powered other than by the 
mains (e.g., battery or other alternatively powered applications), such an 
approach is undesirable. Moreover, a scoreboarding approach rapidly 
becomes unwieldy when the processing engine has a large instruction set 
and/or a parallel processing architecture. 

Other approaches can employ read/write queuing. However, such an 
approach is unsuitable where there is a wide variety of pipeline fields and/or 
sources of resource accesses. Moreover, such an approach can also rapidly 
become complex to handle and expensive in terms of logic overhead and 
power consumption. 

A further approach can employ attaching a resource encoding to 
instructions within the pipeline. However, such an approach can also suffer 
from disadvantages similar to those described above. 

Many different types of processors are known, of which 
microprocessors are but one example. For example, Digital Signal Processors 
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(DSPs) are widely used, in particular for specific applications, such as mobile 
processing applications. DSPs are typically configured to optimize the 
performance of the applications concerned and to achieve this they employ 
more specialized execution units and instruction sets. Particularly in, but not 
5 exclusively, applications such as mobile telecommunications applications, it 
is desirable to provide ever increasing DSP performance while keeping power 
consumption as low as possible. 

There is, therefore,^ a need for a different approach to resource 
conflict management within a pipeline for avoiding data hazards, which does 
10 not suffer from the disadvantages of the prior approaches described above. 
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Summary of the Invention 



Particular and preferred aspects of the invention are set out in the 
accompanying independent and dependent claims. Combinations of features 
from the dependent claims may be combined with features of the independent 
claims as appropriate and not merely as explicitly set out in the claims. 

In accordance with an aspect of the invention, there is provided a 
processing engine including a processor pipeline with a plurality of pipeline 
stages, a plurality of resources and a pipeline protection mechanism. The 
pipeline protection mechanism includes interlock circuitry for anticipating 
access conflicts for each protected resource of the plurality of resources 
between the pipeline stages. An output^the interlock detection circuitry is 
controllably connected to a set of shadow registers. The set of shadow 
registers are interconnected with the processor pipeline such that a data item 
from a first pipeline stage can be redirected into a selected shadow register in 
response to an access conflict anticipated by the interlock circuitry so that a 
resource access conflict is resolved without stalling the processor pipeline. 

The resources could, for example, be registers or parts (e.g. fields) of 
registers. 

The interlock circuitry comprises interlock detection circuitry that is 
operable to anticipate access conflicts for all of the protected resources and 
that is operable to form a stall vector signal. Reservation and filtering 
circuitry is connected to receive the stall vector signal and is operable to 
select an available shadow register from the set of shadow registers in 
response to the stall vector signal. Shadow management circuitry is 
connected to the reservation and filtering circuitry. The shadow management 
circuitry has an output signal controllably connected to the set of shadow 
registers. 
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Preferably, the arbitration logic for each of the resources is derived 
from a generic arbitration logic determined for the pipeline. The generic 
function may itself be embodied in the integrated circuit as generic 
arbitration logic capable of handling simultaneous occurrence of all envisaged 
conflicts. Each of the arbitration logic blocks may fully embody the generic 
arbitration function, but will typically only embody different special forms of 
the generic arbitration function. The generic arbitration function provides a 
logical definition of all of the potential, or theoretical, conflicts which could 
occur between respective pipeline stages. In practice, it may not be 
physically possible for all of the theoretical conflicts to occur for each of the 
resources, since the resources concerned may not be accessible at all of the 
pipeline stages being monitored. However, configuring the respective 
arbitration logic blocks from a single, generic function simplifies the design of 
the logic for the individual resources, and provides consistent performance 
and testability. 

The processing engine will typically include pipeline control logic for 
controlling the stages of the pipeline. This pipeline control logic can be 
connected to receive the stall control signals derived, or output, from the 
arbitration logic. Output merge logic can be provided for merging the output 
of each arbitration logic to form stall control signals for controlling the 
selective stalling of the pipeline to avoid the resource access conflicts. 

The access information can relate to pending accesses. It can also 
relate to current access. Indeed, a current access decoding stage can be 
connected to receive current access information from the pipeline to derive 
current access information for respective protected resources, the arbitration 
logic for a protected resource being connected to receive current access 
information for that protected resource as well as pending access information. 

The processing engine can be in the form of a digital signal processor. 
Alternatively, it could be in the form of a microprocessor, or any other form of 
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processing engine employing a pipelined architecture. The processing engine 
can be implemented in the form of an integrated circuit. 

A particular application for a processing engine in accordance with the 
present invention is in the form of a wireless telecommunications device, in 
particular a portable telecommunications device such as, for example, a 
mobile telephone, where low power consumption and high processing 
performance is required. 

In accordance with another aspect of the invention there is provided a 
method of protecting a pipeline in a processing engine, which processing 
engine includes a processor pipeline with a plurality of pipeline stages and a 
plurality of resources. The method comprises the steps of: separately 
arbitrating, for respective protected resources, to anticipate access conflicts 
between the pipeline stages for the each resource, and redirecting a data item 
from a first pipeline stage into a selected shadow register in response to an 
anticipated access conflict so that a resource access conflict is resolved 
without stalling the processor pipeline. 
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Brief Description of the Drawings 

Particular embodiments in accordance with the invention will now be 
described, by way of example only, and with reference to the accompanying 
5 drawings in which like reference signs are used to denote like parts, unless 
otherwise stated, and in which: 

Figure 1 is a schematic block diagram of a processor in accordance with 
an embodiment of the invention; 

Figure 2 is a schematic diagram of a core of the processor of Figure 1; 
10 Figure 3 is a more detailed schematic block diagram of various 

execution units of the core of the processor of Figure 1; 

Figure 4 is schematic diagram of an instruction buffer queue and an 
instruction decoder controller of the processor of Figure 1; 

Figure 5 is a schematic representation of the core of the processor for 
15 explaining the operation of the pipeline of the processor; 

Figure 6 is a block diagram of the processor illustrating a memory 
management unit interconnected memory; 

Figure 7 shows the unified structure of Program and Data memory 
spaces of the processor; 
20 Figure 8A is an example of a read after write hazard; 

Figure 8B is another example of a read after write hazard; 

Figure 9 is ari example of a write after write hazard; 

Figure 10A is one example of a write after read hazard; 

Figure 10B is another example of a write after read hazard; 
25 Figure 11 illustrates possible conflicts at various pipeline stages; 

Figure 12 illustrates the derivation of a generic arbitration function 
definition process; 

Figure 13 is a schematic diagram of generic arbitration logic; 
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Figure 14 is a block diagram illustrating shadow registers and control 
circuitry for delayed writes, according to an aspect of the present invention; 

Figure 15 is a schematic diagram of arbitration circuitry for delayed 
writes of Figure 14; 

Figure 16 is a schematic block diagram of an exemplary structure for 
an interlock control mechanism using the arbitration circuitry of Figure 15; 

Figure 17 a block diagram of a reservation and filter circuit for the 
shadow registers of Figure 14; 

Figure 18 is a schematic diagram for a lookahead structure for the 
filter circuit of Figure 17; 

Figure 19 is a schematic diagram of multiplexor circuitry for stall 
length selection for the filter circuitry of Figure 17; 

Figure 20 is a block diagram of shadow management circuitry for the 
shadow registers of Figure 14; 

Figure 21 is a block diagram of the shadow management circuitry of 
Figure 20 illustrating the state machine control circuitry; 

Figure 22 is a schematic of circuitry for routing data from shadow 
registers to target registers in the register file of Figure 14; 

Figure 23 is a state diagram which illustrates operation of the state 
machine of Figure 21; 

Figure 24A is a timing diagram illustrating a one cycle write delay and 
a resulting redirection of a read from a shadow register; 

Figure 24B is a timing diagram illustrating a one cycle write delay in a 
loop which requires only one shadow register; 

Figure 25A is a timing diagram illustrating a two cycle write delay and 
resulting read redirections from shadow registers in which potential conflicts 
are killed; 

Figure 25B is a timing diagram illustrating a two cycle write delay in a 
loop that requires two shadow registers; 
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Figure 26A is a timing diagram illustrating a three cycle write delay 
and resulting read redirections from shadow registers in which potential 
conflicts are killed; 

Figure 26B is a timing diagram illustrating a three cycle write delay in 
5 a loop such that three shadow registers are required; 

Figure 27 illustrates the architecture of a dual-pipeline arithmetic 
logic unit of a processing engine incorporating an embodiment of the 
invention; 

Figure 28 is a spectrum chart illustrating stalls in a typical application 
10 using the circuitry of Figure 12; 

Figure 29 is a distribution chart illustrating stalls that can be removed 
from the application of Figure 28 using the circuitry of Figure 14; 

Figure 30 is an integrated circuit incorporating the processor of Figure 

1; and 

15 Figure 31 is an example of mobile telecommunications apparatus 

incorporating the processor of Figure 1. 
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Description of Particular Embodiments 

Although the invention finds particular application to Digital Signal 
Processors (DSPs), implemented, for example, in an Application Specific 
5 Integrated Circuit (ASIC), it also finds application to other forms of 
processors. 

The basic architecture of an example of a processor according to the 
invention will now be described. Processor 100 is a programmable fixed point 
DSP core with variable instruction length (8 bits to 48 bits) offering both 
10 high code density and easy programming. Architecture and instruction set 
P are optimized for low power consumption and high efficiency execution of 

=p DSP algorithms as well as pure control tasks, such as for wireless telephones, 

^ for example. Processor 100 includes emulation and code debugging facilities. 

.5=} 

^ Figure 1 is a schematic overview of a digital system 10 in accordance 

P 15 with an embodiment of the present invention. The digital system includes a 
processor 100 and a processor backplane 20. In a particular example of the 
;£ invention, the digital system is a Digital Signal Processor System 10 

^ implemented in an Application Specific Integrated Circuit (ASIC). In the 

■*p interest of clarity, Figure 1 only shows those portions of microprocessor 100 

20 that are relevant to an understanding of an embodiment of the present 
invention. Details of general construction for DSPs are well known, and may 
be found readily elsewhere. For example, U.S. Patent 5,072,418 issued to 
Frederick Boutaud, et al, describes a DSP in detail and is incorporated herein 
by reference. U.S. Patent 5,329,471 issued to Gary Swoboda, et al, describes 
25 in detail how to test and emulate a DSP and is incorporated herein by 
reference. Details of portions of microprocessor 100 relevant to an 
embodiment of the present invention are explained in sufficient detail herein 
below, so as to enable one of ordinary skill in the microprocessor art to make 
and use the invention. 
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Several example systems which can benefit from aspects of the present 
invention are described in U.S. Patent 5,072,418, which was incorporated by 
reference herein, particularly with reference to Figures 2-18 of U.S. Patent 
5,072,418. A microprocessor incorporating an aspect of the present invention 
to improve performance or reduce cost can be used to further improve the 
systems described in U.S. Patent 5,072,418. Such systems include, but are 
not limited to, industrial process controls, automotive vehicle systems, motor 
controls, robotic control systems, satellite telecommunication systems, echo 
canceling systems, modems, video imaging systems, speech recognition 
systems, vocoder-modem systems with encryption, and such. 

A description of various architectural features and a description of a 
complete set of instructions of the microprocessor of Figure 1 is provided in 
co-assigned application Serial No. ■ V v ( f I y I-28433), which is incorporated 
herein by reference. 

As shown in Figure 1, processor 100 forms a central processing unit 
(CPU) with a processor core 102 and a memory interface unit 104 for 
interfacing the processor core 102 with memory units external to the 
processor core 102. 

Processor backplane 20 comprises a backplane bus 22, to which the 
memory management unit 104 of the processor is connected. Also connected 
to the backplane bus 22 is an instruction memory 24, peripheral devices 26 
and an external interface 28. 

It will be appreciated that in other examples, the invention could be 
implemented using different configurations and/or different technologies. For 
example, processor 100 could form a first integrated circuit, with the 
processor backplane 20 being separate therefrom. Processor 100 could, for 
example be a DSP separate from and mounted on a backplane 20 supporting 
a backplane bus 22, peripheral and external interfaces. The processor 100 
could, for example, be a microprocessor rather than a DSP and could be 



TI-28234 - 11 



implemented in technologies other than ASIC technology. The processor or a 
processor including the processor could be implemented in one or more 
integrated circuits. 

Figure 2 illustrates the basic structure of an embodiment of the 
5 processor core 102. As illustrated, this embodiment of the processor core 102 
includes four elements, namely an Instruction Buffer Unit (I Unit) 106 and 
three execution units. The execution units are a Program Flow Unit (P Unit) 
108, Address Data Flow Unit (A Unit) 110 and a Data Computation Unit (D 
Unit) 112 for executing instructions decoded from the Instruction Buffer Unit 
10 (I Unit) 106 and for controlling and monitoring program flow. 
□ Figure 3 illustrates the P Unit 108, A Unit 110 and D Unit 112 of the 

p processing core 102 in more detail and shows the bus structure connecting 

^ the various elements of the processing core 102. The P Unit 108 includes, for 

^ example, loop control circuitry, GoTo/Branch control circuitry and various 

p 15 registers for controlling and monitoring program flow such as repeat counter 
]a> registers and interrupt mask, flag or vector registers. The P Unit 108 is 

coupled to general purpose Data Write busses (EB, FB) 130, 132, Data Read 
3j busses (CB, DB) 134, 136 and an address constant bus (KAB) 142. 

o Additionally, the P Unit 108 is coupled to sub-units within the A Unit 110 

20 and D Unit 112 via various busses labeled CSR, ACB and RGD. 

As illustrated in Figure 3, in the present embodiment the A Unit 110 
includes a register file 30, a data address generation sub-unit (DAGEN) 32 
and an Arithmetic and Logic Unit (ALU) 34. The A Unit register file 30 
includes various registers, among which are 16 bit pointer registers (AR0- 
25 AR7) and data registers (DR0-DR3) which may also be used for data flow as 
well as address generation. Additionally, the register file includes 16 bit 
circular buffer registers and 7 bit data page registers. As well as the general 
purpose busses (EB, FB, CB, DB) 130, 132, 134, 136, a data constant bus 140 
and address constant bus 142 are coupled to the A Unit register file 30. The 
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A Unit register file 30 is coupled to the A Unit DAGEN unit 32 by 
unidirectional busses 144 and 146 respectively operating in opposite 
directions. The DAGEN unit 32 includes 16 bit X/Y registers and coefficient 
and stack pointer registers, for example for controlling and monitoring 
5 address generation within the processing engine 100. 

The A Unit 110 also comprises the ALU 34 which includes a shifter 
function as well as the functions typically associated with an ALU such as 
addition, subtraction, and AND, OR and XOR logical operators. The ALU 34 
is also coupled to the general-purpose buses (EB,DB) 130,136 and an 
10 instruction constant data bus (KDB) 140. The A Unit ALU is coupled to the 
M P Unit 108 by a PDA bus for receiving register content from the P Unit 108 

p register file. The ALU 34 is also coupled to the A Unit register file 30 by 

buses RGA and RGB for receiving address and data register contents and by 
If, a bus RGD for forwarding address and data registers in the register file 30. 

F 15 In accordance with the illustrated embodiment of the invention, D Unit 

U 112 includes a D Unit register file 36, a D Unit ALU 38, a D Unit shifter 40 

and two multiply and accumulate units (MAC1, MAC2) 42 and 44. The D 
]S Z Unit register file 36, D Unit ALU 38 and D Unit shifter 40 are coupled to 

0 buses (EB, FB, CB, DB and KDB) 130, 132, 134, 136 and 140, and the MAC 

20 units 42 and 44 are coupled to the buses (CB, DB, KDB) 134, 136, 140 and 
Data Read bus (BB) 144. The D Unit register file 36 includes 40-bit 
accumulators (AC0-AC3) and a 16-bit transition register. The D Unit 112 can 
also utilize the 16 bit pointer and data registers in the A Unit 110 as source 
or destination registers in addition to the 40-bit accumulators. The D Unit 
25 register file 36 receives data from the D Unit ALU 38 and MACs 1&2 42, 44 
over accumulator write buses (ACW0, ACW1) 146, 148, and from the D Unit 
shifter 40 over accumulator write bus (ACW1) 148. Data is read from the D 
Unit register file accumulators to the D Unit ALU 38, D Unit shifter 40 and 
MACs 1&2 42, 44 over accumulator read buses (ACR0, ACR1) 150, 152. The 
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D Unit ALU 38 and D Unit shifter 40 are also coupled to sub-units of the A 
Unit 108 via various buses labeled EFC, DRB, DR2 and ACB. 

Referring now to Figure 4, there is illustrated an instruction buffer 
unit 106 in accordance with the present embodiment, comprising a 32 word 
instruction buffer queue (IBQ) 502. The IBQ 502 comprises 32x16 bit 
registers 504, logically divided into 8 bit bytes 506. Instructions arrive at the 
IBQ 502 via the 32-bit program bus (PB) 122. The instructions are fetched in 
a 32-bit cycle into the location pointed to by the Local Write Program Counter 
(LWPC) 532. The LWPC 532 is contained in a register located in the P Unit 
108. The P Unit 108 also includes the Local Read Program Counter (LRPC) 
536 register, and the Write Program Counter (WPC) 530 and Read Program 
Counter (RPC) 534 registers. LRPC 536 points to the location in the IBQ 502 
of the next instruction or instructions to be loaded into the instruction 
decoder/s 512 and 514. That is to say, the LRPC 534 points to the location in 
the IBQ 502 of the instruction currently being dispatched to the decoders 512, 
514. The WPC points to the address in program memory of the start of the 
next 4 bytes of instruction code for the pipeline. For each fetch into the IBQ, 
the next 4 bytes from the program memory are fetched regardless of 
instruction boundaries. The RPC 534 points to the address in program 
memory of the instruction currently being dispatched to the decoder/s 
512/514. 

In this embodiment, the instructions are formed into a 48 bit word and 
are loaded into the instruction decoders 512, 514 over a 48 bit bus 516 via 
multiplexers 520 and 521. It will be apparent to a person of ordinary skill in 
the art that the instructions may be formed into words comprising other than 
48-bits, and that the present invention is not to be limited to the specific 
embodiment described above. 

For presently preferred 48-bit word size, bus 516 can load a maximum 
of 2 instructions, one per decoder, during any one instruction cycle for 
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parallel execution. The combination of instructions may be in any 
combination of formats, 8, 16, 24, 32, 40 and 48 bits, which will fit across the 
48-bit bus. Decoder 1, 512, is loaded in preference to decoder 2, 514, if only 
one instruction can be loaded during a cycle. The respective instructions are 
then forwarded on to the respective function units in order to execute them 
and to access the data for which the instruction or operation is to be 
performed. Prior to being passed to the instruction decoders, the instructions 
are aligned on byte boundaries. The alignment is done based on the format 
derived for the previous instruction during decode thereof. The multiplexing 
associated with the alignment of instructions with byte boundaries is 
performed in multiplexors 520 and 521. 

Two instructions can be put in parallel if one of the two instructions is 
provided with a parallel enable bit. The hardware support for such type of 
parallelism is called the parallel enable mechanism. Likewise, two 
instructions can be put in parallel if both of the instructions make single data 
memory accesses (Smem, or dbl(lmem)) in indirect mode. The hardware 
support for such type of parallelism is called the soft dual mechanism. 

Processor core 102 executes instructions through a 7 stage pipeline, the 
respective stages of which will now be described with reference to Table 1 and 
to Figure 5. The processor instructions are executed through a seven stage 
pipeline regardless of where the execution takes place (A unit or D unit). In 
order to reduce program code size, a C compiler, according to one aspect of 
the present invention, dispatches as many instructions as possible for 
execution in the A unit, so that the D unit can be switched off to conserve 
power. This requires the A unit to support basic operations performed on 
memory operands. 
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Pipeline stage 


Description. 


PO 


Pre-Fetch 


Address program memory via the program address bus PAB. 


PI 


Fetch 


Read program memory through the program bus PB. 

Fill instruction buffer queue with the 4 bytes fetched in program memory. 


P2 


Decode 


Read instruction buffer queue (6 bytes) 
Decode instruction pair or single instruction. 

Dispatch instructions on Program Flow Unit (PU), Address Data Flow Unit (AU), and 

Tints* Clnmniitfltinn Unit (DTT) 


ro 


Address 


Data address computation performed in the 3 address generators located in AU : 

rl C'l^UlIiputaLlUIl Ul dUUlCSO tU Uc gcllcl dlcLl 111 . 

- direct SP/DP relative addressing mode. 

- indirect addressing mode via pointer registers. 

- Pnc;t"-f*OTTirnit;iHnri nn nnintpr rpin^tpr^t in * 

- indirect addressing mode via pointer registers. 

Program address computation for PC relative branching instructions: goto, call, switch. 


P4 


appose 


Read memory operand address generation on BAB, CAB, DAB buses. 
Read memory operand on CB bus (Ymem operand). 


P5 


Read 


Read memory operand on DB (Smem, Xmem operand), on CB and DB buses (Lmem 
operand), on BB (coeff operand) 

Write memory operand address generation on EAB and FAB buses. 


P6 


Execute 


Execute phase of data processing instructions executed in A unit and D unit. 
Write on FB bus (Ymem operand). 

Write Memory operand on EB (Smem, Xmem operand ), on EB and FB buses (Lmem 
operand). 



Table 1: Processor Pipeline Operation for a 
Single Cycle Instruction With No Memory Wait States 



The first stage of the pipeline is a PRE-FETCH (PO) stage 202, during 
which stage a next program memory location is addressed by asserting an 
address on the address bus (PAB) 118 of a memory interface 104. 

In the next stage, FETCH (PI) stage 204, the program memory is read 
and the I Unit 106 is filled via the PB bus 122 from the memory interface 
unit 104. 

The PRE-FETCH and FETCH stages are separate from the rest of the 
pipeline stages in that the pipeline can be interrupted during the PRE- 
FETCH and FETCH stages to break the sequential program flow and point to 
other instructions in the program memory, for example for a Branch 
instruction. 

The next instruction in the instruction buffer is then dispatched to the 
decoder/s 512/514 in the third stage, DECODE (P2) 206, where the 
instruction is decoded and dispatched to the execution unit for executing that 
instruction, for example to the P Unit 108, the A Unit 110 or the D Unit 112. 
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The decode stage 206 includes decoding at least part of an instruction 
including a first part indicating the class of the instruction, a second part 
indicating the format of the instruction and a third part indicating an 
addressing mode for the instruction. 

The next stage is an ADDRESS (P3) stage 208, in which the address of 
the data to be used in the instruction is computed, or a new program address 
is computed should the instruction require a program branch or jump. 
Respective computations take place in A Unit 110 or P Unit 108 respectively. 

In an ACCESS (P4) stage 210, the address of a read operand is 
generated and the memory operand, the address of which has been generated 
in a DAGEN Y operator with a Ymem indirect addressing mode, is then 
READ from indirectly addressed Y memory (Ymem). 

The next stage of the pipeline is the READ (P5) stage 212 in which a 
memory operand, the address of which has been generated in a DAGEN X 
operator with an Xmem indirect addressing mode or in a DAGEN C operator 
with coefficient address mode, is READ. The address of the memory location 
to which the result of the instruction is to be written is generated. 

Finally, there is an execution EXEC (P6) stage 214 in which the 
instruction is executed in either the A Unit 110 or the D Unit 112. The result 
is then stored in a data register or accumulator, or written to memory for 
Read/Modify/Write instructions. Additionally, shift operations are performed 
on data in accumulators during the EXEC stage. 

Processor 100 ? s pipeline is protected. This significantly improves the C 
compiler performance since no NOP's instructions have to be inserted to meet 
latency requirements. It also makes the code translation from a prior 
generation processor to a latter generation processor much easier. 

A pipeline protection basic rule used in processor 100 is as follows: if a 
write access has been initiated before the on going read access but not yet 
completed and if both accesses share the same resource then extra cycles are 
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inserted to allow the write completion and execute next instruction with the 
updated operands; but for emulation, a single step code execution must 
behave exactly as free running code execution. 

The basic principle of operation for a pipeline processor will now be 
described with reference to Figure 5. As can be seen from Figure 5, for a first 
instruction 302, the successive pipeline stages take place over time periods 
T r T 7 . Each time period is a clock cycle for the processor machine clock. A 
second instruction 304, can enter the pipeline in period T 2 , since the previous 
instruction has now moved on to the next pipeline stage. For instruction 3, 
306, the PRE-FETCH stage 202 occurs in time period T 3 . As can be seen from 
Figure 5 for a seven stage pipeline a totpUof.7 instructions, may be processed 
simultaneously. For all 7 instructions oU2-31^, 'Figure 5 shows them all 
under process in time period T 7 . Such a structure adds a form of parallelism 
to the processing of instructions. 

As shown in Figure 6, the * present embodiment of the invention 
includes a memory interface unit 104 which is coupled to external program 
storage memory 150 via a 24 bit address bus 118 and a 32 bit bi-directional 
data bus 120. Additionally, the memory interface unit 104 is coupled to data 
memory units 151 via a 24 bit address bus 114 and a bi-directional 16 bit 
data bus 116. The memory interface unit 104 is also coupled to the I Unit 106 
of the machine processor core 102 via a 32 bit program read bus (PB) 122. 
The P Unit 108, A Unit 110 and D Unit 112 are coupled to the memory 
interface unit 104 via data read and data write buses and corresponding 
address buses. The P Unit 108 is further coupled to a program address bus 
128. 

More particularly, the P Unit 108 is coupled to the memory interface 
unit 104 by a 24 bit program address bus 128, the two 16 bit data write buses 
(EB, FB) 130, 132, and the two 16 bit data read buses (CB, DB) 134, 136. The 
A Unit 110 is coupled to the memory interface unit 104 via two 24 bit data 
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write address buses (EAB, FAB) 160, 162, the two 16 bit data write buses 
(EB, FB) 130, 132, the three data read address buses (BAB, CAB, DAB) 164, 
166, 168 and the two 16 bit data read buses (CB, DB) 134, 136. The D Unit 
112 is coupled to the memory interface unit 104 via the two data write buses 
(EB, FB) 130, 132 and three data read buses (BB, CB, DB) 144, 134, 136. 

Figure 6 represents the passing of instructions from the I Unit 106 to 
the P Unit 108 at 124, for forwarding branch instructions for example. 
Additionally, Figure 6 represents the passing of data from the I Unit 106 to 
the A Unit 110 and the D Unit 112 at 126 and 128 respectively. 

Processor 100 is organized around a unified program/data space, as 
illustrated in Figure 7. A program pointer is internally 24 bits and has byte 
addressing capability, but only a 22 bit address is exported to memory since 
program fetch is always performed on a 32 bit boundary. However, during 
emulation for software development, for example, the full 24 bit address is 
provided for hardware breakpoint implementation. Data pointers are 16 bit 
extended by a 7 bit main data page and have word addressing capability. 

Software can define up to 3 main data pages, as follows: 

MDP Direct access Indirect access CDP 

MDP05 - Indirect access AR[0-5] 

MDP67 - Indirect access AR[6-7] 

A stack is maintained and always resides on main data page 0. CPU 
memory mapped registers are visible from all the pages. 

Various aspects of processor 100 are summarized in Table 2. 
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Very Low Power programmable processor 


Parallel execution of instructions, 8-bit to 48-bit instruction format 


Seven stage pipeline (including pre-fetch) 


- Instruction buffer unit highlight 


32x16 buffer size 

Parallel Instruction dispatching 

Local Loop 


Data computation unit highlight 


Four 40 bit generic (accumulator) registers 

Single cycle 17x17 Multiplication-Accumulation (MAC) 

40 bit ALU, "32 + 8* or "(2 x 16) + 8 " 

Special processing hardware for Viterbi functions 

Barrel shifter 


Program flow unit highlight 


32 bits/cycle program fetch bandwidth 
24 bit program address 

Hardware loop controllers (zero overhead loops) 
Interruptible repeat loop function 
Bit field test for conditional jump 
Reduced overhead for program flow control 


Data flow unit highlight 


Three address generators, with new addressing modes 

Three 7 bit main data page registers 

Two Index registers 

Eight 16 bit pointers 

Dedicated 16 bit coefficients pointer 

Four 16 bit generic registers 

Three independent circular buffers 

Pointers & registers swap 

16 bits ALU with shift 


Memory Interface highlight 


Three 16 bit operands per cycle 
32 bit program fetch per cycle 
Easy interface with cache memories 


C compiler 




Algebraic assembler 





Table 2: Summary of Improved Processor 100 



A difficulty with the operation of a pipeline is that different 
instructions may need to make access to one and the same resource. Quite 
often, a firsLinstruction will be operable to modify a resource, for example a 
register ^a part, for example a field, of a register and a second instruction 
may then need to access that resource. If the instructions were being 
processed separately with the processing of the second instruction only being 
commenced when the processing of the first instruction has finished, this 
would not create a conflict. However, in a pipelined architecture, there is a 
possibility that a second instruction could access the resource before the first 
instruction has finished with it, unless measures are undertaken to prevent 
this. 
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Such potential conflicts are often termed "data hazards". Examples of 
possible data hazards are in cases of, for example: 

Read after Write (e.g.: ARx = ARy followed by *ARx = kl6) 
Write after Read (e.g.: ARx = ARy followed by mar(ARy=P16)) 
Write after Write (e.g.: ARx = ARy followed by mar(ARx=P16)) 
Figure 8A represents an example of a pipeline protection action for a 
Read After Write (RAW). Step 600 represents a write performed by a first 
instruction in an execute phase (EXE) on a register AR1 (e.g. AR1 = ARO + 
K16). Step 602 represents a read performed in the address phase (ADR) on 
AR1 (e.g. ACO = *AR1). A pipeline protection action (604) comprises setting a 
stall 606 for the address phase, whereby the addresses for the read are not 
generated at 610 (the read of AR1 is not valid) until after the write to AR1 is 
performed at 612, the new AR1 value being available and the stall for the 
address phase being relaxed (removed) at 614. 

Figure 8B represents another example of a pipeline protection action 
for a Read After Write (RAW). Step 620 represents a write performed by a 
first instruction in an execute phase (EXE) on a register ARO (e.g. ARO = ACO 
+ K16). Step 622 represents a read performed in the read phase (RD) on ARO 
(e.g. Condition Read/Memory Mapped Register (MMR) read). A pipeline 
protection action (624) comprises setting a stall 626 for the access phase 
(ACC), by prediction, whereby the addresses and requests are kept active at 
628, a write on ACO is performed at 630 and the stall of the access phase is 
relaxed (removed) and the Condition/MMR new value is available at 632. 
Alternatively, a stall could be inserted during the read phase at 630 instead 
of at the access phase. 

Figure 9 represents an example of a pipeline protection action for a 
Write After Write (WAW). Step 640 represents a write performed by a first 
instruction in an execute phase (EXE) on a register AR1 (e.g. AR1 = ARO + 
K16). Step 642 represents a write performed in the address phase (ADR) on 



TI-28234 - 21 



AR1 (e.g. ACO = *AR1+). A pipeline protection action (644) comprises setting 
a stall 646 for the address phase, whereby the addresses for the second write 
to AR1 are not generated at 648 (the write to AR1 is not allowed) until after 
the first write to AR1 is performed at 650, the new AR1 value being available 
5 and the stall for the address phase being relaxed (removed) at 652. 

Figure 10A represents an example of a pipeline protection action for a 
Write After Read (WAR). Step 660 represents a read performed by a first 
instruction in a execute phase (EX) on a register AR3 (e.g. AC2 = AR3 + K8). 
Step 662 represents an write performed in the address phase (ADR) on AR3 

10 (e.g. *AR3+DR0). A pipeline protection action (664) comprises setting a stall 
666 for the address phase, whereby the addresses for the write to AR3 are not 
generated at 668 (the write to AR3 is not allowed) until the read of AR3 is 
performed at 670, the AR3 write being allowed during the same phase at 670. 
The read and write of AR3 can be performed in the same phase at 670 

15 because the read gets the "old" value of AR3. The stall for the address phase 
being relaxed (removed) at 672. 

Figure 10B represents another example of a pipeline protection action 
for a Write After Read (WAR). Step 680 represents a read performed by a 
first instruction in a read phase (RD) on a register AR3 (e.g. Condition or 

20 MMR). Step 682 represents a write performed in the address phase (ADR) on 
AR3 (e.g. *AR3 + DR0). A pipeline protection action (684) comprises setting a 
stall 686 for the address phase, whereby the addresses for the write to AR3 
are not generated at 688 (the write to AR3 is not allowed) until the read of 
AR3 is performed at 690, the write to AR3 then being allowed and the stall 

25 for the address phase being relaxed (removed). 

Figure 11 is a schematic of an approach adopted for determining a 
definition of a generic arbitration function of all possible resource access 
conflicts of the pipeline. The generic arbitration function is an abstract 
concept which underpins and simplifies the design of each arbitration logic, 
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which can all be implemented as special forms of the generic function. Logic 
in which the generic arbitration function is embedded may also be included in 
the processing engine. The generic arbitration function can also aid circuit 
testing at the end of the circuit design. Although described in the context of 
5 the present embodiment, this approach could be used for other processor 
architectures. 

Referring to Figure 11, in an initial step (1) the organization (700) of 
the processing engine as a whole is divided into groups of registers, or 
register files (e.g. 702, 704, 706). In the present example, three register files 
10 exist for the program unit, or control flow (CF), for the data unit (DU) and for 
O the address unit (AU). Each of the register files comprises a number of 

; g registers N(i) (e.g., 708, 710, 712). These registers can form the resources to 

V2 be protected. As well as, or instead of, protecting whole registers, it may be 

F desired to protect parts of (or fields within) registers (e.g. 714, 716, 718). 

,g 15 Figure 11 represents this definition of resource granularity. Accordingly, a 
protected resource could, for example, be a register or a field within a 
^ register. 

For each protected resource, an analysis of the worst possible resource 
: q usage is derived in step 2. Different instructions will provide different ways 

20 of reading from and writing to a resource, for example. As shown in Figure 
11 in respect of register field 714, the pipeline stages represented at 720 in 
which read/write operations could be performed for that resource are stages 
P3, P5 and P6. In other words, the worst case resource usage for this resource 
is in respect of pipeline stages P3, P5 and P6. The above accesses can be 
25 classified in terms of their execution stages. 

The pipeline depth (e.g., here pipeline stages P2, P3, P4, P5 and P6) 
has to be taken into account in step 3 to consider the instruction execution 
overlap, as represented at 722 for five instructions II, 12, 13, 14 and 15. 
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All potential data hazards are considered as represented by the arrows 
in Figure 12, which Figure is a schematic diagram illustrating potential 
conflicts at different stages of a pipeline. Figure 12 illustrates the five stages 
P2 - P6 of Figure 5 for each of the four instructions 10, II, 12 and 13 and 14. 
5 From the consideration of the data hazards found, a generic arbitration 

function can be derived as illustrated in Figure 13, this generic arbitration 
function defining relationships between current and pending accesses. The 
generic arbitration function can then be used to control the selective stalling 
of the pipeline to avoid data hazards. The generic logic is representative of 
10 all potential resource access conflicts for the pipeline. From an analysis of 
the potential conflict problems represented schematically in Figure 12, the 
following signals susceptible to resulting in a conflict can be identified, 
namely: 

a: current read stage P3 

15 b: pending (stage P4) read stage P6 

c: pending (stage P4) read stage P5 

d: current read stage P5 

e: pending (stage P5) read stage P6 

f: current read stage P6 

20 1: current write stage P3 

2: pending (stage P4) write stage P6 

3: pending (stage P4) write stage P5 

4: pending (stage P5) write stage P6 

5: current write stage P5 

25 6: current write stage P6 

The logic for interpreting these signals and forming a signal stall-stage 

4 for stalling the ADR (P3) stage and a signal stall-stage 5 for stalling the 

ACC (P4) stage is illustrated in Figure 13. It will be noted that signals "d" 

and "f are not shown in Figure 13. These signals are not, however, needed 

30 as all potential conflicts dealing with a 7-stage read are solved by 

anticipating using the pending signals "b" and "e". Accordingly, these signals 

do not need to be represented in Figure 13 as any conflicts related thereto can 

already be predicted. 
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It will thus be appreciated that in general the generic function will 
have a large number of variable operands and that each arbitration logic will 
be a special form or sub-set of the generic function with a lower degree of 
degeneracy, i.e. with a number of the operands which are variable in the 
5 generic function being fixed. 

Once determined, the generic arbitration function can be used to 
implement the circuit design of each of the arbitration logic blocks, which are 
all definable as special forms of the generic arbitration function. The full 
generic form is not needed for the arbitration logic of each individual 
10 resource, since, for each of the resources, it will in general be impossible for 
Q some of the conflicts envisaged by the generic arbitration function to occur, 

g Generic arbitration logic embodying the generic arbitration function 

\2 need only be provided in the processing engine if full protection is desired 

;P against simultaneous occurrence of all envisaged conflicts. 

=p 15 Another aspect of the present invention is illustrated with reference to 

5^ Figures 9, 10A and 10B. Using a dynamic reordering approach for write 

;rf cycles, such as score-boarding or queuing, is difficult in the microprocessor of 

H the present embodiment. This is due to the fact that to be able to modify the 

:Q instruction execution order the full resource usage of the issued instructions 

20 must be known. In this embodiment, any register can be accessed by an 
instruction through an indirect address. This address is known (usable) by 
the hardware only from the stage 5. Therefore, most instructions having an 
addressing mode can't he reordered. However, it has now been discovered 
that another techniques may be used to minimize the Interlock stall penalty. 
25 According to an aspect of the present invention, a technique that is disclosed 
herein dynamically re-directs the destination of a conflicting write to a set of 
shadow registers when free and thus delays the real destination writing from 
the stage 4 to a later one so that the conflict is avoided. 
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In one embodiment, the approach is dedicated to write after read 
(WAR) conflicts as illustrated in Figures 10A and 10B and write after write 
(WAW) conflicts as illustrated in Figure 9. This technique may be used to 
reduce stall penalty relative to just a subset of the register file, or to the 
entire set of registers in the microprocessor. If only a subset of registers is 
chosen, then the number of shadow register in the stack can be determined 
by analysis of application code that will be executed on the microprocessor. 
Likewise, the subset of registers that would benefit form this stack can be 
chosen from an application code study defining where the conflicts are and 
how often they occur. 

Figure 14 is a block diagram illustrating shadow registers 1400 and 
control circuitry for delayed writes, according to an aspect of the present 
invention. Basically the logic is composed of 3 sub-units: interlock detection 
unit 1402, reservation and filtering unit 1404, and shadow management unit 
1406. 

Interlock Detection Unit 1402 contains arbitration circuitry similar to 
Figure 13, but with enhancements to identify stall that can be eliminated by 
performing a delayed write. Each arbitration logic generates a stall and an 
expected length (cycle) of stall (worst one).The delayed writes are now taken 
into account through the transfer signals from the SM-Unit. According to 
another aspect of the present invention, no added read after write (RAW) 
dependencies are added by this logic thanks to a read redirection mechanism. 

Reservation and Filtering Unit 1404 selects a free shadow register 
from shadow register stack 1400 to receive a conflicting write. This unit is 
composed of a K cascaded fast filter (using carry lookahead adder (CLA) type 
architecture) and destination/stall-length encoding circuitry, where K is the 
number of shadow registers. 

Shadow Management Unit 1406 receives and saves the destinations 
and stall length information. It generates controls for register file 832 to 
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redirect the writes 1410, to swap the shadow content to the destination 1410, 
and to redirect the reads 1412. Coefficient signals 1420 are sent to filters 
1404. Stall signals 1430 identifying all the stalls from the stage 4 to 7 are 
received from pipeline and control circuitry 820 in order to remain 
synchronous with the pipeline pace. 

A set a shadow registers 1400 with muxing data busses is included in 
register file 832. 

Merge circuitry 1440 receives direct stall signals 1441 and filtered stall 
signals 1442 and forms stall signals 1443 which are sent to pipeline control 
circuitry 830 to stall the pipeline. Direct stall signals 1441 indicate stalls 
that can't be eliminated by a delayed write. Filtered stall signals 1442 
indicate stalls that could have been eliminated, except that an empty shadow 
register was not available. 

Figure 15 is a schematic diagram of arbitration circuitry for delayed 
writes of Figure 14. Basically the arbitration function is the same as shown 
in Figure 13, but split to distinguish the WAW, WAR from the RAW conflicts 
and also to differentiate the 1,2 or 3 cycles stall length. RAW conflicts are 
still solved by simple stall and are thus sent directly to the 2nd level of Merge 
logic. Direct stall signals 1441a and 1441b are asserted for RAW conflicts. 
Stall vector 1450 and length encoding signal 1451 are sent to filter unit 1404 
and indicate when a WAW or a WAR conflict is detected. 

The following additional signals are provided to the stall arbitration 

circuitry: 

7: pending stage 3 for stage 6 
8: pending stage 3 for stage 5 
9: pending stage 5 for stage 6 
10: current write from shadow register 

Additional signals 7-9 allow a stall resulting from a redirected read to 
be killed. Signal 10 allows a WAW conflict resulting from a delayed write to 
be detected. 
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Figure 16 is a schematic block diagram of exemplary structure for an 
interlock control mechanism 1402 using the arbitration circuitry of Figure 15, 
for example, for the pipeline 820 of Figure 14. It will be understood that the 
mechanism could have the same structure for other pipelines, such as the 
pipeline 850 of Figure 30. It will be noted that no memory elements 
(read/write queue) are provided for stall management as the instruction 
pipeline itself is used to achieve this. For example, a write after write conflict 
from stage P3 to stage P6 of the pipeline between two consecutive 
instructions should generate a 3 cycle stall (at stage P3). In practice, the 
interlock logic generates 3x1 cycle consecutive stalls (at stage P3). 

Figure 16 illustrates a regular and parallel structure for hazard 
detection, including: 

first level comprises basic decoders 882 (from pending accesses 
or current accesses). These decoders are the same as decoders 880 in the 
register files but are applied on the pending signals. The decoder logic is 
responsive to access information from at least selected pipeline stages to 
derive access information for respective protected resources. The decoders 
882 are operable to decode pending access information. The decoders 880 are 
operable to decode current accesses. 

A second level comprises a stage 884 of merging of the 
equivalent signals (in the arbitration function sense) for each register to 
protect. This is achieved by ORing those signals in OR gates, for example 
using logic as illustrated in Figure 13. The output of the decoders 880 for 
current accesses are merged in merge logic 883, and then are supplied to 
merge logic 884, where they are merged with the output of the decoders 882 
for pending access. 

A third level is composed of as many sets of arbitration logic 886 
as there are registers to protect. The arbitration logic is extracted from the 
arbitration function illustrated in Figure 15, according to the inputs thereto 
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(i.e. it forms a sub-set of the arbitration logic of Figure 15), and is applied 
(reduced) to each register access trace. The register access traces are formed 
from incoming signals specifying an access/phase. Each arbitration circuit 
1600a outputs a stall_stage4 signal 1650a and a length encoding signal 
1651a. Thus, a stall vector is formed having a number of bits T equal to the 
number of target registers that are being detected. 

A fourth level is simply the merge 1440 (Figure 14) of all the 
arbitration results, for example using OR gates. Each set of arbitration logic 
generates up to two stalls (at stages 3, and/or 4). All the stalls of the same 
stage are merged together. The merged output signals are supplied as stall 
control signals 1443 to the associated pipeline control logic for controlling 
selective stalling of the pipeline. 

The*stall control signals 1444 are supplied to register access control 
logic 4$ftJ for current access control. Advantageously, since stall penalty 
reduction is performed in this embodiment, only conflicts which are not 
resolved by delayed writes will result in an appropriate pipeline stall, that is 
a freeze of the lower stages and bubble insertion at the next stage. 

The arbitration logic is relatively simple in hardware as a result of its 
'logic re-use'. By logic re-use it is meant that the arbitration lqgic makes -use 
of tapping from the queue of the existing main pipeline 1&2 1 " 028 (rather tnan 
creation of a new queue for arbitration purposes which has been previously 
proposed) and also makes use of the results from the decoders 880, in the 
embodiment through the merge logic 883. Consequently, the additional 
amount of hardware required for the arbitration logic blocks is greatly 
reduced. In a specific hardware implementation of the embodiment as a DSP 
integrated circuit, all the arbitration logic covers less than 2% of the total 
CPU area. By contrast, it is estimated that without logic re-use the chip area 
required for the logic necessary to provide a comparable level of pipeline 
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protection would be at least several times greater, perhaps an order of 
magnitude greater. 

The concept of the generic arbitration function can be further exploited 
at the stage of software testing of the hardware design of the processing 
5 engine. In general, generating all the test patterns for pipeline processing 
engine hardware can be a huge undertaking because of the complexity of the 
CPU, its instruction set and architecture. The test patterns need to be 
defined in terms of a pre-specified reference. It is the specification of this 
reference which can be highly laborious. With the present design, a 

10 functional test pattern generator can be created using the generic function as 
the reference in association with a conventional instruction set latency table. 
This simplifies the creation of the test pattern generator since the scope of 
the testing can be restricted to the possible conflicts envisaged by the generic 
function. Because the test pattern generator follows directly from the generic 

15 function, the process of hardware design testing is not only quicker, but also 
more systematic and ensures good coverage. 

Figure 17 a block diagram of a reservation and filter circuit 1404 for 
three shadow registers of Figure .14. This Unit receives the stalls (WAR- 
WAW) via stall vector signals 4?50 and selects K of them, where K can be 0- 

20 3, to be resolved by re-directing the write into a free shadow register. The 
shadow register will keep this value until the conflict is solved (known by the 
length information) and then write into the correct destination register. 
When the stall register has been selected, the corresponding destination code 
1462 and stall length cy()is encoded and sent to SMU 1406. The selected stall 

25 is cleared from stall vector 1450 before being sent to the next Filter stage. 
After all the filters 1700(n) (as many as there are shadows), the filtered stall 
vector is sent to the 2nd level of merge 1440 to generate a stall action if 
shadow registers are busy or if there are more than three conflicts at a time. 
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• 



Other embodiments may have more or fewer shadow registers, in which case, 
K is selected accordingly. 

Each encoder 1710a-c generates a destination code (real target write) 
from the R[N:0] vector. Table 3 is its truth table. 

5 



R[3] 


R[2] 


R[l] 


R[0] 


CODE 


0 


0 


0 


0 


000 


0 


0 


0 


1 


100 


0 


0 


1 


0 


101 


0 


1 


0 


0 


110 


1 


0 


0 


0 


111 



note that the R[i] are exclusive. 



Table 3: Shadow Destination Code Encoding Table 

10 In the present embodiment, this approach targets a reduced bench of 

registers, such as the Auxiliary Registers and Data Registers, in order to 
minimize the number of shadow registers. In Figure 16, there are eight 
arbitration circuits 1600 for eight target registers such that an eight bit stall 
vector is formed. Filtering is serialized, therefore it is advantageous to use a 

15 fast implementation. 

If we call 

S[i] : the ith bit of the input stall vector 

C[i] : the filter coefficient coeffln) propagated up to the ith bit. 
(C[o] = 1 if the shadow is free) 
20 SF [i] : the filtered value of S [i] 

R[i] : a bit selection flag 
then equations (1), (2), and (3) define how SF{I} and C{I+1} are 
determined. Table 4 is a truth table which illustrates these relations for four 
target registers. A different number of target registers is accommodated by 
2 5 similar encodings . 
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Sti] 


C[i] 


SF[i] 


C[i+1] 


R[i] 


0 


0 


0 


0 


0 


1 


0 


1 


0 


0 


0 


1 


0 


1 


0 


1 


1 


0 


0 


1 



Table 4: Select Filter Truth Table 



(1) SF[i] = S\i]& C[i] 

(2) C[i + l] = S[i]& C[i] 



-> C[i) = -S[p]&C[0] (3) 

o 

where: 

C[0] = 1 if the shadow is free 



Figure 18 is a schematic diagram for a lookahead structure for the 
filter circuit of Figure 17. This structure is contained within each of the 
filters 1700a-c. Another embodiment may use a lookahead structure, but 
with different implementation to improve its speed, such as for example a 
fast-carry processing CLA. However, as for an adder, any parallel prefix 
architecture (like CLA, fast-CLA, ...) could be used depending on the timing 
constraints of the design. Figure 18 illustrates an embodiment for four target 
registers wherein a four bit stall vector S[3-0] is provided. 

Figure 19 is a schematic diagram of multiplexor circuitry 1720 for stall 
length selection for the filter circuitry of Figure 17. Mux circuitry 1720^is 
controlled by signals R[i] and ^lec+s one stall length L() 1451 from among 
the K inputs. Signals Cy[x] Xl&I convey the selected stall length to SMU 
1406. 

Figure 20 is a block diagram of shadow management circuitry 1406 for 
the shadow registers of Figure 14. Figure 21 is a block diagram of the 
shadow management circuitry of Figure 20 illustrating the state machine 
control circuitry 2100. !' 
, . . This unit receives destination signals 1462. and stall length signals 
-¥t2± from RF-Unit 1404, and stall and the write enable signals 2000 (for 
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conditional instructions)- Destination register 3O±0 stores the destinatipn 
v . code. Length regis ter^W*^ stores the stall length. Increment register>S&r4 *is 
incremented to form the pending write signals. From those signals, Shadow 
Management Unit 1406 generates the following signals: 
5 - Reg2Sh[i] signals 2010: transfer write orders from stage 3 

register Reg to shadow [i]. This also causes a write to a conflicted stage 3 
register to be killed. 

Sh[i]2Reg signals 2012: write order from shadow[i] to a 
previously conflicted register. 
10 - Coeff[i] signals 2014: free shadow [i] signal used as coefficient in 

RF-unit. 

Pending writes signals 2016: sent to ID-unit 1402 to manage 
conflicts which may arise in stages 4 and 5 as a result of a delayed write from 
a shadow register. 

15 - redirect read signals 2110: orders for stage 3, 5, 6 to the register 

file. Redirect signals are active at the start of any operative read cycle. In 
the present embodiment, they are anticipated by one cycle and latched. 

Stage 6 writes are not considered because this would still generate 
conflicts (stalled) with the following reads. In case of 3 cycles delayed write 

20 with an instruction performing a stage 6 write, overwrite priority is given to 
the stage 6 write. Pendings, current writes and redirect read signals are 
generated as described below. Those signals are sent to Interlock Detection 
Unit 1402 and to register file 832. 

Figure 22 is a schematic of circuitry for routing data from shadow 

25 registers to target registers in the register file of Figure 14. Within the 
register file a muxed data path is implemented in-between the targeted 
registers and the shadow registers. Shadow register[i] 2200 is loaded with a 
data item via stage 3 write paths 2202 in response to control signal 
reg2shadow[i] 2012 from SMU 1406 when a conflict is detected. On the same 
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cycle, reg2shadow[i] signal 2010a inhibits writing of the data item to target 
register 2210 so that the detected conflict is killed. The data item is then 
transferred on a later cycle and written to target register 2210 in response to 
control signal shadow2reg[i] as a delayed write cycle. Mux 2206 controlled 
to select the data item from the selected shadow register 2200 from a sfet of 
shadow registers. Mux is controlled to select from one of the stage 3 - 
stage 6 write paths or from a shadow register. 

Muxes 2220, 2222, 2224 and 2226 are provided to allow a redirected 
read from a shadow register to a stage 3, stage 5 or stage 6 read path in the 
case that a data item is not yet written to a target register. 

Figure 23 is a state diagram which illustrates operation of state 
machine 2100 of Figure 21. A separate state machine 2100 is associated with 
each shadow register. Loop 2302 holds state machine 2100 in load state 2300 
during a reset, or when the shadow register associated with state machine 
2300 is not selected, as indicated by signal Cout=0, or when stage 3 is stalled 
as indicated by signal Stall(3). Arc 2304 transitions state machine 2100 to 
count state 2310 when the associated shadow register is selected (Cout=l). 

Signal Reg2Sh v adow[i] 2010 is as oa rted during this transition. Destination 

» -A* 

register .233&-and length register ^^H^are loaded with data corresponding to 
the selected conflict. Increment register attra is loaded with 0. 

In count state 2310, length register^0i2 is decremented each clock 
cycle and increment register-2#3*4 is incremented each clock cycle. Loop 2312 
A holds the state machine in count state 2310 if length register 2$T2 i& greater 
than 0, or if a stall is asserted in a stage that is beyond stage 3 by a value 
equal to the increment register. For example, if the increment register holds 
a value of 2, then count state 2310 is maintained if stage 5 is stalled. 
However, in this case, the length register and increment register are not 
changed. During count state 2310, pending write signals 2016 are asserted. 
Pending write signals are generated during the Count state using the 
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destination-code and the Increment output (Ino) and sent to the Interlock 
detection logic to track any further conflicts. 

Once the length register reaches a value of 0, arc 2314 moves the state 
machine back to load state 2300. Signal shadow2reg[i] 2012 is asserted to 
complete the delayed write of the target register using the contents of the 
shadow register. Transfer write signal Shadow2Reg[i] is generated using the 
Destination-code entry and the Length output (Lo). 

Delaying the writes solves the WAR and/or WAW conflicts but it also 
may introduce side effects which must be considered. In the present 
embodiment three types of side effects detected and managed, as described in 
the following paragraphs. 

Read redirection is performed so that no RAW conflicts are introduced 
by the delay logic. Next reads from the Instruction using the delay 
mechanism MUST use the register value as if the write was done to be 
consistent with the non-conflicting behavior. This is accomplished by 
providing data stored in the associated shadow register via the redirect 
muxes described with respect to Figure 22. 

RAW stalls that may appear when removing the WAW/WAR stalls can 
also be killed by using read redirection. 

WAW conflicts generated by delay write mechanism must be detected. 
These induced WAW conflicts may also be solved with the delayed write 
mechanism if a shadow is free. 

The next figures show the three contexts of delayed write in the 
present embodiment, which may be from one to three cycles. 

Figure 24A is a timing diagram illustrating a one cycle write delay and 
a resulting redirection of a read from a shadow register. Write 2400 is 
detected as a WAR conflict and delayed, according to aspects of the present 
invention, for one cycle until 2402. Because of this delay, read 2404 would 
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require RAW stall; advantageously this stall can be killed by read redirection 
from shadow [i]. 

Figure 24B is a timing diagram illustrating a one cycle write delay in a 
loop which requires only one shadow register. A WAR conflict between write 
2410 and read 2411 is resolved by delayed write 2412. However, this induces 
a WAW conflict with write 2414. Advantageously, this induced WAW conflict 
can also be resolved .delayed write 2416. Since the delay is only one cycle, 
only one shadow register is needed to resolve both conflicts. 

Figure 25A is a timing diagram illustrating a two cycle write delay and 
resulting read redirections from shadow registers in which potential conflicts 
are killed. A WAR conflict for write 2500 is resolved by two cycle delayed 
write 2502. A RAW conflict is induced by this for read 2502. This induced 
conflict is advantageously resolved by a read redirected from shadow [i]. A 
RAW conflict between write 2510 and read 2512 is also advantageously 
resolved by a read redirected from shadow [i]. 

Figure 25B is a timing diagram illustrating a two cycle write delay in a 
loop that requires two shadow registers. A WAR conflict between write 2520 
and read 2521 is resolved by two cycle delayed write 2522. However, this 
induces a WAW conflict with .write 2524. Advantageously, this induced WAW 
conflict can also be resolved detayed write 2526. Since the delay is two cycles, 
two shadow registers are needed to resolve both conflicts. Conflicts between 
write 2524 and write 2530, read 2521 and read 2532 are also advantageously 
resolved by delayed write 2526. Read 2522, and 2526 are also performed 
without a stall by a read redirected from shadow [i] and shadow |j], 
respectively. Read 2534 is also performed without a stall by a read redirected 
from shadow [i]. 

Figure 26A is a timing diagram illustrating a three cycle write delay 
and resulting read redirections from shadow registers in which potential 
conflicts are killed. A WAR conflict for write 2600 is resolved by three cycle 
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delayed write 2602. A RAW conflict is induced by this for read 2602. This 
induced conflict is advantageously resolved by a read redirected from 
shadow[i]. A conflict is also induced by delayed write 2602 for read 2604. 
This induced conflict is advantageously resolved by a read redirected from 
v shadow [i]. A RAW conflict between writes 2610 and 2611 and read^4f^fife 
also advantageously resolved by a read redirected from shadow[i]. Induced 
RAW conflicts for read 2614 and read 2616 are also advantageously resolved 
by reads redirected from shadow [i]. 

Figure 26B is a timing diagram illustrating a three cycle write delay in 
a loop such that three shadow registers are required. A WAW conflict 
between write 2620 and write 2640 is resolved by three cycle delayed write 
2622. However, this induces a WAW conflict with write 2624 and write 2626. 
Advantageously, these induced WAW conflicts can also be resolved v a©layed 
write 2622. Since the delay is three cycles, three shadow registers are needed 
to resolve the three conflicts. A conflict between write 2640 and read 2623 is 
also advantageously killed by delayed write 2622. Read 2622, 2628 and 2630 
are also performed without a stall by a read redirected from shadow [i], 
shadow |j] and shadow [k], respectively. 

Figure 27 illustrates the architecture of a dual-pipeline arithmetic 
logic unit of a processing engine incorporating an embodiment of the 
invention. As shown in Figure 27, there are first and second pipelines 820 
and 850, receiving instructions from a control flow 800. In terms of Figure 2, 
the first pipeline could be the D unit and the second pipeline could be the A 
unit, for example. 

The control flow includes an instruction buffer 810 and first and 
second decoders 812 and 814, for decoding first and second instruction 
streams. A parallel encoding validity check is effected in parallel verification 
logic 816, to ensure that the parallel context is valid. The instructions from 
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the decoders 812 and 814 are dispatched from dispatch logic 818 under the 
control of a dispatch controller 808. 

In the first pipeline 820, successive pipeline stages 822, 824, 826 and 
828 are under the control of a local pipeline controller 830. Associated with 
the first pipeline 820 is first local interlock/filter/shadow logic 838 forming a 
first local interlock controller. Interlock/filter/shadow logic 838 includes 
circuitry similar to IDU 1402, RFU 1404 and SMU 1406. The pipeline 
Controller is responsive to control signals xrom the associated interlock 
control logic to cause selective stalling of the pipelines stages. This is 
responsive to outputs from the pipeline 820 and also to outputs from a 
register file 832 for the pipeline 820. The register file 832 includes register 
file control logic 834 and individual registers 836, some of which are shadow 
registers. Control logic 834 is responsive to interlock/filter/shadow logic 838 
to provide delayed writes to selected target registers so that the occurrence of 
pipeline stalls is advantageously reduced. One or more operators 840 and 
842 may be accessed in respect of a current access operation. 

In the second pipeline 850, successive pipeline stages 852, 854, 856 and 
858 are under the control of a local pipeline controller 860. Associated with 
the second pipeline 850 is second local interlock/filter/shadow control logic 
868 forming a second local interlock controller. The pipeline controller is 
responsive to control signals from the associated interlock control logic to 
cause selective stalling of the pipeline stages. This is responsive to outputs 
from the pipeline 850 and also to outputs from a register file 862 for the 
pipeline 850. The register file 862 includes register file control logic 864 and 
individual registers 866, some of which are shadow registers. Control logic 
864 is responsive to interlock/filter/shadow logic 868 to provide delayed 
writes to selected target registers so that the occurrence of pipeline stalls is 
advantageously reduced. One or more operators 870 and 872 may be 
accessed in respect of a current access operation. 
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It will be noted that each of the local pipeline controllers 830 and 860 
is responsive to outputs from each of the local interlock controllers 838 and 
868 by means of signal 875 which spreads a stall generated by any interlock 
controller to other pipeline controllers. This general principle is extendible. 
Accordingly, where more than two pipelines are provided, the local pipeline 
controller for each pipeline will be responsive to the outputs from all of the 
local interlock controllers. 

Thus, in Figure 27, the natural partitioning of the interlock control is 
the same as for the register files. However, this need not be the case and it 
may be desirable to move an individual interlock control (e.g., 838 or 868) 
from its original register file to another depending on the arbitration function 
information location (pending verses current accesses). 

As mentioned above, in the present embodiment, there are three 
register files, namely for the control flow (CF), for the D unit (DU) and for the 
A unit (AU). Accordingly three sets of local interlock control logic are 
provided. The physical location of the control logic is, however, distributed 
such that pending and/or current accesses information is mainly located at 
the respective location (AU,CF). For the D unit, the interlock logic is moved 
to the control flow unit, where the biggest percentage of signals for control is 
pending in the instruction pipeline. By re-using as much as possible current 
accesses of the register files the logic overhead can be minimized. Stalls 
which are generated are spread within all the CPU sub-units having a 
pipeline and the associated local pipeline control logic. Advantageously, 
according to aspects of the present invention, conflicts that are resolved by 
delayed writes through shadow registers do not generate stalls. 

There has been described herein a pipeline protection mechanism 
which, as a result of its regularity and generality is straightforward to 
implement and to test. Queuing of read/write pending operations is handled 
by the pipeline itself. Thus the interlock detection logic is purely 
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combinatorial and does not require a read/write queue as part of the interlock 
mechanism. 

Figure 28 is a spectrum chart illustrating stalls in a typical application 
using the circuitry of Figure 12. The application used for this benchmark is a 
vocoder code applied on a set of 4 frames (45Kcycles). Figure 28 illustrates 
the stage 4 stall frequency during the code execution. 

Figure 29 is a distribution chart illustrating stalls that can be removed 
from the application of Figure 28 using the circuitry of Figure 14. Figure 29 
illustrates the same stalls distributed in-between the internal registers, 
making the distinction between the RAW and the WAW/WAR conflicts. From 
this it can be determined that up to 50% of those conflicts are solved without 
bubble insertion using circuitry according to aspects of the present invention. 

Figure 30 is a schematic representation of an integrated circuit 40 
incorporating the processor 10 of Figure 1. The integrated circuit can be 
implemented using application specific integrated circuit (ASIC) technology. 
As shown, the integrated circuit includes a plurality of contacts 42 for surface 
mounting. However, the integrated circuit could include other configurations, 
for example a plurality of pins on a lower surface of the circuit for mounting 
in a zero insertion force socket, or indeed any other suitable configuration. 

One application for a processing engine such as the processor 10, for 
example as incorporated in an integrated circuit as in Figure 31, is in a 
telecommunications device, for example a mobile wireless telecommunica- 
tions device. Figure 1?* illustrates one example of such a telecommunications 
device. In the specific example illustrated in Figured, the telecommunica- 
tions device is a mobile telephone If with integrated user input device such 
as a keypad, or keyboard 12 and a display 14. The display could be 
implemented using appropriate technology, as, for example, a liquid crystal 
display or a TFT display. The processor 10 is connected to the keypad 12, 
where appropriate via a keyboard adapter (not shown), to the display 14, 
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where appropriate via a display adapter (not shown), and to a telecommuni- 
cations interface or transceiver 16, for example a wireless telecommunica- 
tions interface including radio frequency (RF) circuitry. The radio frequency 
circuitry could be incorporated into, or separate from, an integrated circuit 40 
comprising the processor 10. The RF circuitry 16 is connected to an aerial 18. 

Fabrication of data processing device 100 involves multiple steps of 
implanting various amounts of impurities into a semiconductor substrate and 
diffusing the impurities to selected depths within the substrate to form 
transistor devices. Masks are formed to control the placement of the 
impurities. Multiple layers of conductive material and insulative material 
are deposited and etched to interconnect the various devices. These steps are 
performed in a clean room environment. 

A significant portion of the cost of producing the data processing device 
involves testing. While in wafer form, individual devices are biased to an 
operational state and probe tested for basic operational functionality. The 
wafer is then separated into individual dice which may be sold as bare die or 
packaged. After packaging, finished parts are biased into an operational 
state and tested for operational functionality. 

An alternative embodiment of the novel aspects of the present 
invention may include other circuitries which are combined with the 
circuitries disclosed herein in order to reduce the total gate count of the 
combined functions. Since those skilled in the art are aware of techniques for 
gate minimization, the details of such an embodiment will not be described 
herein. 

Thus, there has been described a processor that is a programmable 
digital signal processor (DSP), offering both high code density and easy 
programming. Architecture and instruction set are optimized for low power 
consumption and high efficiency execution of DSP algorithms, such as for 
wireless telephones, as well as pure control tasks. The processor includes an 
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instruction buffer unit, and a data computation unit for executing the 
instructions decoded by the instruction buffer unit. Instructions can be 
executed in a parallel manner, either in response to implicit parallelism or in 
response to user defined parallelism. 
5 Pipeline conflicts are detected as they occur and many of the detected 

conflicts are resolved by use of a set of shadow registers to provide delayed 
writing to conflicted target registers. Reads may be redirected to a selected 
shadow register to resolved conflicts induced by the delayed write. 

Another embodiment may have more than two pipelines which are 
10 interlocked via stall detection. 

Another embodiment may have a larger or a fewer number of target 
registers that are protected by a set of shadow registers. 

Another embodiment may use another technique for detecting pipeline 
conflicts. However a pipeline conflict is detected, a shadow register may be 
15 employed according to an aspect of the present invention to resolve the 
conflict. 

Another embodiment may omit read redirection. 

As used herein, the terms "applied," "connected," and "connection" 
mean electrically connected, including where additional elements may be in 
20 the electrical connection path. 

While the invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting 
sense. Various other embodiments of the invention will be apparent to 
persons skilled in the art upon reference to this description. It is therefore 
25 contemplated that the appended claims will cover any such modifications of 
the embodiments as fall within the true scope and spirit of the invention. 
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